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ABSTRACT 

Thisstudy  ai  med  to  identify  the  mi  nimumfontsizethat  supports  fast  and  accurate  identification 
of  text  and  symbols  displayed  on  an  LCD  under  ambient  lighting  conditions  similar  to  those  in 
naval  ships'  operations  rooms.  A  series  of  letters,  numbers  and  combat  symbols  were  displayed 
on  an  LCD  for  either  106  ms  or  173  ms.  Participants  were  asked  to  identify  each  stimulus  and  the 
certainty  of  their  decision.  Letters  and  numbers  were  presented  in  white,  red,  green  and  cyan,  and 
symbols  were  either  white  or  colour-coded.  The  stimulus  heights  subtended  angles  of  between 
8  minutes  and  20  minutes.  The  study  identified  the  minimum  height  at  which  accuracy  and 
certai  nty  were  not  si  gni  fi  cantl  y  red  uced .  Two  experi  ments  were  performed :  one  on  a  I  and-based 
sample,  and  one  using  Canadian  Defence  Force  personnel  during  a  sea  trial  in  an  attempt  to 
identify  the  potential  affects  of  ships  motion  and  fatigue.  Colour  significantly  improved  the 
identification  accuracy  and  certainty  of  symbols.  Red  numbers  and  letters  were  identified  with 
significantly  lower  confidence  than  white,  green  or  cyan.  Some  performance  degradation  was 
observed  during  the  sea  trial,  and  it  is  suggested  that  text  and  symbols  ideally  havea  height  of 
16  min  or  greater,  but  that  a  height  of  12.5  min  or  greater  is  acceptable.  A  height  of  less  than 
12.5  min  must  not  be  used  for  text  or  symbols  that  need  to  be  rapidly  identified. 
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Identification  of  Text  and  Symbols  on  a  Liquid 
Crystal  Display  Part  III:  The  Effect  of  Ambient  Light, 

Colour  and  Size 


Executi  ve  Su  mmary 

The  Royal  A  u stral  i  an  N  avy  A  N  ZA  C  C I  ass  F ri  gates  are  bei  ng  u pgrad ed  w  i  th  an  enhanced 
Anti-Ship  Missile  Defence  (ASMD)  capability  that  includes  the  development  of  a  new 
Combat  M  anagement  System  (C  M  S) .  A  s  I  ong  as  good  d  i  spl  ay  pri  nci  pi  es  arefol  I  owed  and 
the  limits  of  human  cognitive  processing  are  recognised,  increasing  the  information 
available  to  the  user  on  each  screen  can  improve  situational  awareness  and  decision 
making.  Reducing  thefont  size  is  one  method  of  increasing  data  density,  however  if  the 
font  size  becomes  too  small,  reading  speed  and  accuracy  will  deteriorate.  Thus  oneaspect 
of  the  design  of  the  new  CMS  is  to  identify  how  small  text  and  symbols  can  be  made 
without  compromising  reading  speed  and  accuracy.  An  empirical  study  was  performed 
that  exami  ned  the  effect  of  si  ze  on  the  abi  I  ity  to  accu  ratel  y  and  confi  dentl  y  i  dentify  rapi  d  I  y 
presented  text  and  combat  symbols  on  a  liquid  crystal  display  (LCD)  under  lighting 
conditions  similar  to  those  experienced  in  ANZAC  operations  (ops)  rooms. 

Participants  were  presented  with  a  series  of  letters,  numbers  and  combat  symbols 
displayed  on  an  LCD  for  either  106  ms  or  173  ms,  and  asked  to  identify  each  stimulus  and 
thei  r  I  evel  of  confi  dence  i  n  thedeci  si  on.  Thesti  mul  i  ranged  i  n  sizefrom  8  mi  nutes  (min)  of 
arc  to  20  min.  Letters  and  numbers  were  presented  in  white,  red,  green  and  cyan.  Symbols 
were  either  white  or  coloured.  White  symbols  could  be  identified  by  their  shape,  and 
coloured  symbols  had  redundant  colour  coding  (both  shape  and  colour)  to  assist 
identification.  Two  primary  experiments  were  performed,  one  land-based  using  DSTO 
employees,  and  one  performed  using  Canadian  Armed  Forces  members  during  a  sea  trial 
i  n  an  attempt  to  i  dentify  the  possi  bl  e  effects  of  shi  p's  moti  on  and  observer  fati  gue  on  text 
and  symbol  identification. 

The  resu Its  i  ndi  cated  that  col  ou red  symbol  s  w ere  i  denti f i  ed  w i th  si  gn i f i  cantl y  fewer  errors 
and  significantly  higher  certainty  than  white  symbols,  thus  confirming  the  benefits  of 
redundant  coding.  Red  letters  and  numbers  were  identified  with  alower  certainty  than  the 
other  colours,  but  did  not  significantly  differ  in  identification  accuracy.  Thus  red  is  not  a 
preferred  colour  unless  the  colour  also  conveys  information. 


The  results  of  the  land-based  experiment  suggested  that  numbers,  letters  and  symbols 
should  have  a  height  of  12.5 min  or  greater  to  maintain  accuracy  and  certainty  of 
identification.  No  differences  were  found  between  the  short  and  long  display  time 
conditions.  The  results  of  the  sea-based  experiment  suggested  that  numbers,  letters  and 
symbols  should  have  a  height  of  16  min  or  greater  to  maintain  optimum  identification 
performance.  However,  this  height  could  possibly  be  reduced  to  12.5 min  without 
affecting  reading  speed.  For  an  LCD  with  luminance  and  contrast  settings  appropriate  for 
the  prevailing  ambient  light  levels,  the  foil  owing  recommendations  can  be  made  about 
character  size  and  colour: 

•  Whiteand  coloured  numbers,  letters  and  combat  symbols  must  be  displayed  ata 
minimum  character  height  of  12.5 min  in  order  to  support  rapid  and  accurate 
i  d  enti  f  i  cati  on ,  an d  shou  I  d  be  d  i  sp I  ay ed  at  a  mi  n  i  mu  m  ch aracter  h ei  ght  of  16  mi  n  to 
enable  optimum  identification  performance  in  an  at-sea  environment. 

•  The  use  of  red  is  not  recommended  unless  the  colour  is  being  used  to  convey 
information.  In  this  case,  a  blended  red  is  preferred  to  pure  red  for  text  and 
symbols. 
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1.  Introduction 

The  Royal  Australian  Navy  (RAN)  ANZAC  Class  Frigates  are  being  upgraded  with  an 
enhanced  Anti-Ship  Missile  Defence  (ASMD)  capability.  The  upgrade  will  include  the 
development  of  a  new  Combat  Management  System  (CMS),  which  will  integrate  the  ships' 
war  fighting  capability  by  displaying  information  from  sensors  such  as  radar  and  sonar  and 
al  I  ow  i  ng  the  control  of  w  eapons.  I  nformati  on  i  s  general  I  y  d  i  spl  ayed  on  computer  screens  and , 
as  long  as  good  display  principles  arefol  lowed  and  thelimits  of  human  cognitive  processing 
are  recognised,  the  display  of  additional  information  on  CMSscreenscan  lead  to  increased 
situational  awareness  and  better  decision  maki  ng.  Thus,  there  is  often  a  desire  to  maximise  the 
information  available  to  the  user  on  each  screen.  Reducing  font  size  is  one  method  of 
increasing  data  density,  however  if  thefont  sizeistoo  small,  reading  speed  and  accuracy  will 
deteriorate.  One  aspect  of  the  design  of  the  new  CMS  is  to  identify  how  small  text  and 
symbols  can  be  made  without  compromising  reading  speed  and  accuracy. 

Identification  of  characters  displayed  on  a  computer  screen  isaffected  by  boththevisual  angle 
subtended  by  the  character  and  the  number  of  pixels  that  comprise  each  character.  Text  needs 
to  be  both  large  enough  to  exceed  visual  acuity  limits,  and  be  comprised  of  enough  pixelsto 
enablean  undistorted  character  shape  to  be  formed.  MIL-STD-1472F  specifies  the  mini  mum 
text  and  symbol  size  to  be  21  minutes  of  arc  (min)  for  coloured  characters  and  16  min  for 
black-and-white  characters,  butallowstextsizeto  be  reduced  to  10  min  in  shared  large  screen 
displays  (DoD,  1999a).  It  also  specifies  that  each  character  be  comprised  of  at  least  10  pixels 
vertically.  BSR/  FI  FES  100  states  that  16  to  18  min  is  normally  adequate  for  rapid  and 
accurate  identification  of  individual  characters,  but  allows  10  min  when  speed  of  recognition 
isunimportant(FIFES,  2005) .  1 1  al  so  sped  f  i  es  th  at  L  ati  n  al  p  ha-  n  u  meri  c  ch  aracters  need  to  be  at 
I  east  9  pi  xel  s  hi  gh .  The  standards  appear  to  be  I  argel  y  based  on  stud  i  es  performed  i  n  the  1980s 
and  early  1990s (Chung,  Mansfield,  &  Legge,  1998;  Giddings,  1972;  Legge,  Parish,  Luebker,& 
Wurm,  1990;  Legge,  Pelli,  Rubin,  &  Schleske,  1985;  Legge,  Rubin,  &  Luebker,  1987; 
Strasburger,  Fiarvey,  &  Rentschler,  1991),  which  typically  used  screens  with  resolutions 
between  70dpi  and  80dpi.  At  these  resolutions,  characters  with  a  height  of  9  or  10 pixels 
would  subtend  a  visual  angle  between  17  min  and  19  min  at  a  viewing  distance  of  650  mm. 
Thus  it  is  possible  that  the  text  height  limits  in  the  specifications  aredriven  by  pixel  effects 
rather  than  visual  acuity  effects.  Given  that  current  computer  displays  can  reach  resolutions  of 
over  100  dpi,  it  is  possiblethattext  and  symbol  sizes  less  than  16  min  may  now  be  acceptable. 

In  a  recent  study  that  examined  the  effect  of  character  size  on  the  ability  to  identify  letters 
displayed  on  a  computer  screen,  Sheedy,  Subbaram,  Zimmerman,  and  Fi  ayes  (2005)  verified 
that  legibility  of  both  upper  and  I  ower-case  I  etters  i  ncreased  with  the  number  of  verti  cal  pixels 
per  character  up  to  9  pi  xel  s,  then  stabi  I  i  sed .  The  need  for  characters  to  have  at  I  east  9  verti  cal 
pixels  is  in  close  agreement  with  both  M IL-STD-1472F  and  BSF  /  FI  FES  100,  butthestudy  did 
not  report  the  character  hei  ght  atwhich  legibility  stabi  I  i  sed  i  n  mi  nutes  of  arc.  The  study  al  so 
found  that  isolated  letters  had  higher  legibility  than  letters  presented  within  words,  which 
they  attri  buted  as  a  manifestati  on  of  the  crowdi  ng  effect.  Thi  s  i  s  the  phenomenon  where  it  i  s 
more  difficult  to  identify  characters  when  presented  among  other  characters  than  when 
presented  in  isolation  (Flom,  Weymouth,  &  Kahneman,  1963;  Stuart  &  Burian,  1962). 
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Legi  bi  I  ity  refers  to  th e  mi  n i  mu  m  text  si  ze  at  w  h i  ch  I  etters  can  be  i  d enti f i  ed .  H  ow ever,  text  an d 
symbols  generally  need  to  be  several  times  larger  than  the  minimum  legible  height  before 
maxi  mum  reading  speed  can  be  achieved.  In  a  CMS  display,  it  is  not  enough  that  thetext  and 
symbols  are  legible  to  the  operator;  they  must  be  identified  quickly,  accurately  and  easily.  In 
one  of  the  most  recent  studies  on  speeded  character  identification,  Chung,  Mansfield,  and 
Legge  (1998)  found  that  reading  speed  increased  with  font  size  until  the  letters  reached  a 
height  of  11  min,  after  which  no  further  increase  in  reading  speed  was  achieved.  This  result 
was  based  on  reading  of  meaningful  sentences.  When  random  words  were  used  the 
maximum  reading  speed  decreased  approximately  2.4  times.  However,  it  was  not  reported  if 
this  also  affected  the  mini  mum  text  size  wherecritical  reading  speed  was  achieved.  Thus  fast 
and  accurate  identification  may  bepossiblewith  a  character  size  below  16  min  when  reading 
meani  ngfu  I  sentences,  but  the  si  ze  necessary  for  random  words  or  characters  i  s  I  ess  cl  ear.  The 
identification  task  faced  by  CM  S  operators  does  not  involve  reading  meaningful  words  in  a 
sentence  structure,  but  rather  requires  the  identification  of  symbols  and  short  letters  and 
number  strings  which  do  not  necessarily  form  meaningful  words.  It  is  therefore  not  clear 
w  hether  character  hei  ghts  of  11  mi  n  w i  1 1  be  suffi  ci  ent  for  use  on  C  M  S  d i  spl  ays. 

I  n  a  readi  ng  task,  words  presented  i  n  sentences  and  paragraphs  must  be  serial  ly  scanned  and 
processed  linguistically  to  extract  information  and  meaning.  As  identified  above  the  task 
faced  by  CMS  operators  is  somewhat  different  from  text  reading  as  they  must  identify 
symbol  s  and  short  I  etter  and  nu  mber  stri  ngs  w  hi  ch  are  used  to  bui  I  d  and  mai  ntai  n  si tuati  onal 
awareness  of  the  tactical  environment.  This  leads  to  a  I  ess  constrained  pattern  of  fixations  as 
attention  is  directed  to  the  various  locations  on  the  screen  which  contain  the  information 
necessary  to  interpret  the  display.  Thus  the  task  is  more  akin  to  scene  perception  than 
traditional  reading,  although  both  areachieved  through  a  series  of  eye  movements.  The  most 
i  important  types  of  eye  movements  are  fi  xati  ons,  w  here  the  eye  i  s  rel  ati  vel  y  stabl  e  and  vi  sual 
information  is  obtained,  and  saccades,  where  the  eye  moves  at  a  relatively  high  velocity  to  a 
new  fixation  target  (Rayner,  1998).  The  way  information  is  arranged  onthescreen  will  havean 
important  influence  on  the  ability  of  an  operator  to  quickly  and  effectively  extract  relevant 
information  from  the  display,  but  as  discussed  above,  the  size  of  thetext  and  symbolsmay 
also  limit  the  speed  at  which  information  can  be  processed  at  each  fixation  point  and  thus  may 
increase  identification  time  or  reduce  identification  accuracy. 

Thetraditional  method  of  establishing  thetext  sizenecessary  to  achievecriti cal  reading  speed 
is  to  measure  the  reading  rate  in  words  per  minute  for  text  of  various  character  sizes. 
H  owever,  as  argued  above,  readi  ng  I  i  nes  of  text  i  s  not  thetask  of  a  C  M  S  operator,  who  gathers 
information  from  symbols  and  short  text  strings  located  at  various  positions  on  the  display 
screen .  Th  u  s  the  abi  I  i  ty  to  rap  i  d  I  y  extract  i  nformati  on  from  d  i  screte  sti  mu  I  i  w  as  consi  d  ered  a 
more  appropriate  test  than  the  reading  speed  for  words  arranged  in  meaningful  sentences. 
Themajority  of  fixations  during  reading  and  scene  perception  last  between  100  ms  and  300  ms 
with  an  averageof  approximately  200  ms,  and  in  thistimei  nformati  on  atthefixation  location 
is  processed  and  the  location  of  the  next  fixation  location  is  planned.  In  each  fixation  it 
appears  that  the  visual  information  necessary  for  object  analysis  can  be  obtained  within  the 
fi  rst  100  ms  (Rayner,  I  nhoff,  M  orri son,  SI owi  rczek,  &  Bertera,  1981;  Rubi  n  &  T urano,  1992;  van 
Diepen,  DeGraef,  &  d'Ydewalle,  1995),  butitisal  so  thought  that  information  can  be  acquired 
throughoutthefixation  (Blanchard,  McConkie,  Zola,  &  Wolverton,  1984). Thetask  used  in  the 
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current  study  was  to  identify  letters,  numbers  and  symbols  that  were  presented  at  various 
si  zes  for  a  peri  od  of  106  ms  before  bei  ng  masked .  A  t  th i  s  exposu  re  d  u  rati  on  the  si  ze  at  w  h i  ch 
identification  performance  begins  to  declinewill  providean  indication  of  the  mini  mum  size 
necessary  for  optimal  visual  information  processing.  However,  as  processing  may  occur 
throughoutthefixation  period,  text  size  may  not  have  a  practical  affect  on  reading  speed  until 
stimuli  cannot  be  effectively  processed  inthe  period  ofanormal  fixation.  A  display  time  of 
173  ms  was  al  so  tested  to  check  whether  a  di  spl  ay  ti  me  approachi  ng  that  of  a  typical  fixati  on 
would  change  the  size  at  which  stimuli  could  be  effectively  identified. 

Both  accuracy  and  self-reported  certainty  were  recorded  as  measures  of  identification 
performance.  If  a  visual  stimulus  is  too  small  to  be  effectively  processed  within  the  viewing 
time,  it  is  clear  that  identification  accuracy  may  suffer.  However,  accuracy  may  not  be  a 
particularly  sensitive  measure  of  the  processing  difficulty  as  a  correct  identification  may  be 
madefroman  incompletely  processed  stimulus,  parti cularlyforthesimplestimuli  used  inthis 
study.  Thus  self-reported  certainty  was  also  measured.  Models  of  eye  movements  propose 
thatafixation  continues  until  the  information  atthecurrentfixation  point  has  been  processed 
to  a  deci  si  on  criteri  on  I  evel  (whi  ch  i  s  assumed  to  be  word  i  dentifi  cati  on),  after  whi  ch  attenti  on 
shifts  away  and  a  saccade  is  triggered  (Henderson  &  Ferreira,  1990;  Morrison,  1984;  Reichle, 
Pollatsek,  Fisher,  &  Rayner,  1998).  Increased  difficulty  in  processing  information  atthepoint 
of  fixation  will  lead  to  longer  fixations,  slower  reading  speeds  and  slower  response  times 
(Kliegl,  Nuthmann,  &  Engpert,  2006;  Rayner,  1998).  However,  in  the  current  study  the 
viewing  time  is  constrained,  and  it  was  reasoned  that  if  the  stimulus  was  not  completely 
processed  in  the  avail  able  time  the  certainty  of  identification  would  be  affected,  even  if  the 
stimulus  was  identified  correctly.  Confidence  is  thought  to  have  a  role  in  the  adaptive 
regulation  of  decisions  (Vickers,  1979,  1985)  and  has  been  shown  to  be  correlated  with 
response  ti  me  (Baranski  &  Petrusic,  1998;  Vickers,  Burt,  Smith,  &  Brown,  1985).  Thus  it  was 
considered  thatthelevel  of  certainty  would  indicate  thelevel  of  processing  that  was  achieved 
i  n  theconstrai  ned  vi  ewi  ng  ti  me,  and  that  a  decrease  i  n  certai  nty  coul  d  be  expected  to  result  i  n 
longer  fixations  which  may  result  in  a  slowing  identification  speed. 

Si  mi  I  ar  to  other  RA  N  combat  shi  ps,  ANZAC  operati  ons  rooms  can  operate  under  either  bri  ght 
or  darkened  lighting  conditions.  Under  bright  conditions  the  level  of  ambient  light  is 
approxi  matel  y  260 1  ux,  whi  ch  i  s  si  mi  I  ar  to  normal  offi  ce  I  i  ghti  ng  I  evel  s  and  prod  uces  photopi  c 
conditions  in  which  the  cones  of  the  retina  dominate.  Under  darkened  conditions  ambient 
lighting  is  around  1.5 lux,  which  is  much  lower  than  normal  indoor  lighting  levels  and 
produces  mesopic  viewing  conditions  where  both  rodsand  cones  are  used.  Under  low  light 
levels,  visual  acuity  and  colour  discrimination  performance  is  lower  than  under  bright 
lighting.  Previousstudies,  which  looked  attheeffects  of  character  size  on  speed  and  accuracy 
of  performance,  havegenerally  been  conducted  under  normal  office  lighting  levels.  Hence, 
text  andsymbolsonCMSdisplays  may  n  eed  to  be  I  arger  th  an  p  revi  ou  s  stu  d  i  es  su  ggest.  G  i  ven 
thi  s  u  ncertai  nty,  the  cu  rrent  study  ai  ms  to  expl  ore  the  mi  ni  mum  acceptabl  e  si  ze  for  text  and 
symbol  s  u  nder  I  i  ghti  ng  cond  i  ti  ons  si  mi  I  ar  to  those  present  i  n  combat  shi  ps  operati  ons  rooms. 
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The  first  study  was  conducted  in  dark  and  bright  lighting  conditions  in  a  land  based 
environment  similar  to  previous  studies,  using  participants  working  'normal'  (0900  to  1700) 
office  hours.  However,  visual  perception  and  cognitive  performance  may  be  adversely 
effected  i  n  a  'real  'ship  operati  onal  envi  ronment  under  the  i  nfl  uence  of  shi  p  moti  ons.  At  the 
moment,  I  i  ttl  e  gu i  d ance  i  s  avai  I  abl  e  as  to  how  on-shore  resu I  ts  shou I  d  be  adj u sted  to  al  I  ow  for 
the  effects  of  an  at-sea  environment.  Hence,  a  second  study  was  conducted  to  identify  the 
smallest  text  and  symbol  size  that  is  appropriate  for  useduring  onboard  naval  operations. 

I  n  total ,  the  current  study  consists  of  three  experi  ments. 

1.  Experiment  1  examines  the  effect  of  character  size  on  the  identification  accuracy  and 
certainty  of  white  and  coloured  letters,  numbers  and  symbol  sunder  darkened  and  bright 
ambient  lighting  conditions  in  a  land-based  study. 

2.  Experiment  2  was  conducted  during  a  sea  trial  conducted  off  Nova  Scotia,  Canada,  in  an 
attempt  to  i  dentify  the  effect  of  shi  ps  moti  on  on  i  dentifi  cati  on  performance.  Experi  ment  2 
f  ol  I  ow  ed  the  same  p  roced  u  re  as  Experi  ment  1,  but  on  I  y  u  sed  w  h  i  te  I  etters  u  n  d  er  d  ar  ken  ed 
ambient  lighting  due  to  constraints  on  the  time  avai  I  able  for  testing.  Experiment  2  also 
used  a  smaller  screen  with  a  lower  resolution  than  used  in  Experiment  1  due  to  space 
constrai  nts  avai  I  abl  e  duri  ng  the  sea  tri  al . 

3.  In  order  to  explore  whether  different  display  screens  may  have  affected  identification 
performance,  Experiment  3  re-tested  a  subset  of  participants  in  Experiment  1  using  the 
same  experi  mental  design  and  procedure  as  Experiment  2. 


2.  Experiment!  -  On  Land 


2.1  Introduction 

This  experiment  examined  the  effect  of  size  on  the  ability  to  identify  letters,  numbers  and 
combat  symbology  briefly  displayed  on  an  LCD.  This  experiment  was  conducted  in  a 
motionless  envi  ronment  and  used  participants  who  worked  normal  officehours(0900-  1700). 

2.2  Method 

2.2.1  Participants 

Twenty-four  volunteers  working  at  DSTO  Edinburgh  participated  inthestudy.  Twenty  of  the 
participants  had  previously  taken  part  in  an  earlier  study  which  aimed  to  identify  the 
character  contrast  and  luminance  levels  necessary  to  achieve  optimal  legibility  (Fletcher, 
Sutherland,  &  Nugent,  2009).  Their  ages  ranged  from  20  to  42,  with  a  mean  age  of  31.5  years 
(SD  =7.6  years).  Therewereequal  numbers  of  males  and  females.  All  participants  were  tested 
for  normal  colour  vision  with  the  12  plate  Ishihara  colour  vision  test  and  had  6/  6  or  better 
binocular  visual  acuity,  corrected  if  necessary,  using  far  and  near  point  optical  charts.  Eight 
participants  had  previous  exposure  to  combat  symbology. 
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2.2.2  Apparatus 

An  Apple  M9179LL/ A  30"  2560x  1600 pixel  60  Hz  LCD  monitor  was  used  to  display  all 
experimental  stimuli.  This  was  driven  by  an  HP  desktop  PC  with  a  P4,  3.6  GHz  processor, 
lGbof  RAM  andaNVIDIA  GeForce  7800  GTX  256MBdual  DVI  video  card.  Custom  software 
was  written  to  control  the  stimulus  presentation  using  Java  RE  6.0  and  PXLab  2.1.6.  A 
T ektronixj  17 1  umi  nance  meter  w  ith  aj  1803 1  umi  nance  sensor  and  a  J 1811  i  1 1  umi  nance  sensor 
was  used  to  measuretheluminanceof  the  LCD  monitor  and  the  ambient  light  levels.  A  chin 
rest  was  used  to  maintain  a  constant  viewing  distance  from  the  screen. 

2.2.3  Stimuli 
2.23.1  Letter  Stimuli 

The  letter  stimuli  consisted  of  one  of  ten  letters,  rendered  in  Verdana  font,  presented  inthe 
centre  of  ei  ght  fl  anki  ng  characters.  The  I  etters  were  based  on  the  Bai  I  ey-Lovi  e  I  etters  (D,  E,  F, 
H,  N,  P,  R,  U,  V,  Z;  (Bailey  &  Lovie,  1976),  however  previous  use  of  these  letters 
(Fletcher  etal.,  2009)  found  that  the  I  etters 'Z'  and  'E'  were  identified  with  a  higher  accuracy 
than  the  other  eight  and  that  participants  often  responded  'Y'  when  'V'  was  displayed. 
Parti  ci  pants  al  so  often  mi  stook '  D '  for  'O ' .  Thus  the  I  etters  'Z'  and '  E'  were  repl  aced  by '  Y'  and 
'O',  giving  a  letter  set  of  D,  F,  H,  N,  O,  P,  R,  U,  V,  Y.  Letters  were  7, 9, 11, 14  or  17  pixels  high, 
w  hi  ch  transl  ated  i  nto  8, 10, 13, 16  or  20  mi  nutes  of  arc  at  the  vi  ew  i  ng  d  i  stance  of  750  mm  used 
i  n  the  experi  ment.  1 1  was  I  i  kel  y  that  identi  fi  cati  on  accuracy  of  the  smal  I  est  I  etter  hei  ght  would 
be  affected  by  the  number  of  pixels  as  well  as  the  visual  angle,  but  as  the  aim  of  the  current 
study  is  to  explore  the  effect  of  size  on  identification  at  realistic  viewing  distances  this 
potential  confound  was  acceptable.  The  letters  were  created  without  using  font  smoothing. 
Letters  were  either  white  (equivalent  RGB  levels),  red  (G  =B  =0),  green  (R  =B  =0)  or  cyan 
(R  =0,  G  =B).  Pure  blue  was  not  used  because  it  had  lower  legibility  than  red  or  green  at 
equivalent  luminance  levels  and  could  not  be  displayed  at  sufficient  I  umi  nance  to  achieve 
optimal  I  legibility  (Fletcher  et  al.,  2009).  MIL-STD-2525B  (DoD,  1999b)  proposes  the  use  of 
cyan  to  depict  'friendly'  units,  therefore  cyan  was  used  in  place  of  blue.  The  letters  had  a 
luminance  of  either  20 cd/  m2  or  60 cd/  m2.  The  lower  luminance  was  used  in  the  1.5  lux 
ambi  ent  I  i  ght  vi  ew  i  ng  cond  i  ti  on  and  the  hi  gher  I  u  mi  nance  was  used  i  n  the  260 1  ux  ambi  ent 
I  i  ght  vi  ew  i  ng  cond  i  ti  ons.  These  I  umi  nance  I  evel  s  have  been  fou  nd  to  maxi  mi  se  I  egi  bi  I  i  ty  and 
produce  similar  legibility  levels  under  the  two  ambient  light  levels  (Fletcher  et  al.,  2009). 

The  letters  were  surrounded  by  eight  crowding  characters  which  were  constructed  by 
superimposing  O,  X  and  +.  The  crowding  characters  were  the  same  hei  ght  as  the  I  etters.  An 
exampleof  a  letter  stimulus  is  shown  in  Figure  1. 


Figurel:  Exampleof  a  crowded  white  letter  stimulus 
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2.23.2  N  umber  Stimuli 

Number  stimuli  wereprepared  in  the  same  manner  as  letter  stimuli,  butwiththedigitsO-  9 
used  instead  of  letters. 

2.2.33  Symbol  Stimuli 

N  i  ne  symbol  s  w  ere  u  sed ,  w  h  i  ch  rep  resented  ei  ther  ai  r,  su  rf  ace  or  su  b-su  rf  ace  u  n  i  ts  that  cou  I  d 
be  hostile,  neutral  or  friendly.  The  shape  of  each  symbol  uniquely  identifies  its  category  which 
is  shown  in  Figure  2.  However,  colour  can  also  be  used  to  provide  additional  redundant 
coding  where  hostile  symbols  are  coloured  red,  neutral  symbols  are  coloured  green  and 
friendly  symbols  are  coloured  cyan.  Thus  symbols  could  be  either  monochrome,  where  no 
colour  coding  is  used  and  whiteis  used  for  all  symbols,  or  colour-coded,  wherecol our  is  used 
to  assist  classification.  The  shape  of  the  symbols  was  derived  from  M I L-STD-2525B 
(DoD,  1999b)  and  created  using  M ilicons software (Guth,  2000). 


Hostile  Neutral  Friendly 


Air 

i _ n 

n 

Surface 

1  o 

□ 

o 

Sub-Surface 

ft  u 

u 

Figure  2:  Example  of  the  monochrome  combat  symbols 

The  density  of  symbols  on  the  CMS  screen  was  not  expected  to  be  as  high  as  for  letters  or 
numbers.  While  each  symbol  will  have  an  associated  character  string  of  several  letters  or 
digits,  symbols  will  not  necessarily  be  clustered  together.  Thus  each  symbol  stimulus 
consisted  of  the  symbol  presented  inthecentreof  onlyfourflanking  characters,  not  eight,  as 
shown  in  Figure  3.  The  symbols  had  the  same  heights  as  the  letters  and  digits,  and  were 
created  with  a  luminance  of  20  cd/  m2  and  60  cd/  m2. 


Figure3:  Example  of  monochrome  hostile  air  stimulus 

2.23.4  D  isplay  Background 

All  stimuli  were  displayed  on  a  black  background  with  a  luminance  of  0.96  cd/  m2  measured 
in  the  centre  of  the  screen.  Luminance  of  the  background  varied  from  0.78 cd/  m2  to 
1.04  cd/  m2  across  the  display  screen. 
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2.2.4  Procedure 

The  stimuli  were  presented  in  blocks  of  letters,  numbers  and  symbols.  Each  block  consisted  of 
a  seri  es  of  tri  al  s  w  hi  ch  presented  one  sti  mu  I  us  for  a  short  peri  od  of  ti  me  before  bei  ng  masked 
by  a  noise  pattern  in  which  each  pixel  was  randomly  allocated  a  grey  level  between  Oand  60. 
Thetask  was  to  identify  the  sti  mul  us  and  the  I  evel  of  certai  nty  associ  ated  with  i  dentifi  cati  on. 
The  stimuli  varied  in  sizeand  colour.  Each  trial  was  initiated  by  a  mouse-dick,  whereupon  a 
fixation  crosswasdisplayed  at  the  centre  of  the  screen  for  200  ms  before  being  replaced  with 
the  sti  mul  us,  which  was  displayed  for  either  106  ms  or  172  ms  before  being  replaced  by  the 
mask  which  remained  on  the  screen  until  the  end  of  the  trial  Screen  buttons  which  allowed 
the  participant  to  identify  the  sti  mu  I  us  and  their  level  of  certainty  appeared  250  ms  after  the 
mask  was  displayed.  Certainty  was  measured  by  a  six- point  scale  which  consisted  of 
"Completely  Certain",  "Highly  Certain",  "Moderately  Certain",  "Moderately  Uncertain", 
"Highly  Uncertain"  and  "CompleteGuess".  Participants  were  instructed  to  select  "Complete 
Guess"  if  they  didn't  seethe  stimulus  because  they  happened  to  blink  or  belooking  away 
w  h  en  i  t  w  as  p  resented .  Th  e  n  u  mber  bl  ock  con  si  sted  of  200  tr  i  al  s  ( 5  si  zes  x  10  d  i  gi  ts  x  4  col  ou  rs, 
each  displayed  for  106  ms).  The  letter  block  consisted  of  250  tri  al  s  (5  sizes  x  10  letters  x 
4  col  ou  rs  d  i  spl  ayed  for  106  ms  pi  us  5  si  zes  x  10 1  etters  x  1  col  ou  r  (w  h  i  te)  d  i  spl  ayed  for  172  ms) . 
The  symbol  bl  ock  consi  sted  of  300  tri  al  s  (5  si  zes  x  6  symbol  s  presented  5  ti  mes  each  x  2  col  our 
conditions).  Each  parti  cipantwas  shown  only  sixofthepossibleninesymbolsto  minimise  the 
number  of  trials.  Participants  saw  either  airand  surface  symbols  or  surface  and  subsurface 
symbols.  Participants  were  randomly  allocated  to  a  low  or  high  ambient  light  condition  and 
th e  ord er  of  bl  ock  p resentati  on  w  as  cou  nter bal  an ced  u  si  n g  a  L  ati  n  sq u are  d esi  g n .  Th e  ord  er  of 
presentation  of  stimuli  within  each  block  was  random.  Participants  undertook  symbol 
i  dentifi  cati  on  practi  ce  before  theexperi  mental  sessi  on  unti  I  a  100%  i  dentifi  cati  on  accuracy  was 
achieved.  Participants  also  undertook  a  practice  letter,  number  and  symbol  block  at  the 
beginning  of  the  experimental  session.  The  experimental  session  took  approximately 
60  minutes,  including  a  10  minute  dark  adaptation  period. 

2.3  Results  and  Discussion 

Datawas  collected  on  the  accuracy  and  self-reported  certainty  for  each  trial.  Trials  where  a 
participant  reported  a  certainty  rating  of  "CompleteGuess"  were  removed  from  analysisto 
el  i  mi  natethe  effect  of  guessi  ng  on  the  results.  Thi  s  only  occurred  for  25 1  etter  tri  al  s,  18  number 
trials  and  17  symbol  trials,  totalling  60  out  of  the  15,360  trials  conducted  in  the  study  (i.e., 
0.4%).  For  each  participant,  the  percentage  of  trials  in  error  and  the  percentage  of  trials  with 
'completely  certain'  responseswerecalculated  in  each  condition.  Accuracy  and  certainty  data 
were  highly  skewed,  with  very  few  errors  made  in  any  size  except  the  smallest  and 
participants  responding  'completely  certain'  in  most  trials  with  larger  stimulus  sizes.  Thus 
non-parametric  tests  using  median  values  were  used  in  the  analysis.  A  significance  I  evel  of 
p  =.05wasused  in  all  tests.  The  results  on  the  effects  of  ambient  light,  colour  and  stimulus 
display  duration  will  be  presented  initially  before  presenting  the  main  result  which  was  the 
effect  of  sti  mu  I  us  size  on  identification  accuracy  and  certainty. 
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2.3.1  The  Effect  of  Ambient  Light  Level 

The  median  and  inter  quarti  I  e  range  of  error  and  certainty  for  each  stimulus  type  under  the 
two  ambient  light  and  character  I  umi  nance  conditions  is  shown  in  Table!  Mann  Whitney  U 
tests  were  performed  to  determine  whether  any  reliable  differences  in  errors  or  certainty 
exi  sted  between  thetwo  I  i  ghti  ng  condi  ti  ons  at  any  character  hei  ght.  The  results  of  the  tests  are 
shown  in  Table  2.  The  findings  indicate  that  ambient  light  appeared  to  have  no  significant 
effect  on  either  of  the  measu  res.  Thus  the  data  can  be  col  I  apsed  across  the  I  i  ghti  ng  cond  i  ti  ons 
in  subsequent  analysis.  The  results  also  suggest  that,  for  any  given  character  height,  there 
should  be  little  difference  in  speed  and  accuracy  of  identification  in  either  darkened  or  bright 
operations  rooms  if  a  text  luminance  of  20 cd /  m2  was  used  with  a  screen  background 
luminanceof  l.Ocd/  m2inthelow  light  condition,  and  atextluminanceof  60  cd/  m2wasused 
with  ascreen  background  luminanceof  l.Ocd/  m2inthebrightlightcondition.Thisresultis 
consistent  with  (Fletcher  etal.,  2009),  wheresimilar  legibility  was  obtained  under  these  two 
ambient  lighting  and  I  umi  nance  conditions. 


Table  1:  M  edian  percentageof  error  responses  and  percentage  of  "completely  certain"  responsesfor 

each  stimulus  type  under  low  and  high  ambient  lighting  conditions.  The  inter  quarti le 
range  is  in  parentheses. 


Character 
Height  (min) 


Errors 

Ambient  Lighting  and  Character 
Low  High 


Certainty 

Ambient  Lighting  and 
Low  High 


Letters 

8 

0.0% 

(0.7%) 

2.5% 

(5.7%) 

58.8% 

(51.3%) 

55.7% 

(43.3%) 

10 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

82.5% 

(23.7%) 

82.5% 

(21.0%) 

12.5 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

97.5% 

(16.9%) 

97.5% 

(15.2%) 

16 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

97.5% 

(10.0%) 

100.0% 

(5.0%) 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

100.0% 

(5.0%) 

100.0% 

(2.5%) 

Numbers 

8 

2.5% 

(2.5%) 

0.0% 

(2.5%) 

74.7% 

(24.2%) 

59.5% 

(42.5%) 

10 

0.0% 

(2.5%) 

0.0% 

(0.0%) 

96.3% 

(8.1%) 

95.0% 

(16.9%) 

12.5 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

100.0% 

(2.5%) 

98.8% 

(3.1%) 

16 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

100.0% 

(3.8%) 

100.0% 

(3.2%) 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.6%) 

Symbols 

8 

7.3% 

(6.3%) 

3.1% 

(4.7%) 

75.0% 

(22.4%) 

67.7% 

(45.2%) 

10 

2.1% 

(4.2%) 

2.1% 

(6.8%) 

83.3% 

(13.0%) 

74.0% 

(44.8%) 

12.5 

0.0% 

(2.1%) 

0.0% 

(2.1%) 

95.8% 

(7.8%) 

89.6% 

(36.4%) 

16 

0.0% 

(2.1%) 

0.0% 

(0.0%) 

97.9% 

(5.2%) 

93.8% 

(28.6%) 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

100.0% 

(5.3%) 

97.9% 

(21.4%) 
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T able2:  R  esults  ofM  ann-Whitney  U  tests  testing  whether  any  significant  differences  in  errors  or 
certainty  existed  between  the  two  lighting  conditions  at  each  character  height 


Character  Height 

df 

Errors 

Certainty 

(min) 

Z 

P 

Z 

P 

Letters 

8 

22 

-1.7 

.100 

-0.3 

.773 

10 

22 

-0.6 

.952 

-0.3 

.750 

12.5 

22 

-1.0 

.317 

-0.2 

.858 

16 

22 

-0.6 

.952 

-1.3 

.194 

20 

22 

0.0 

.317 

0.0 

.973 

Numbers 

8 

22 

-1.0 

.307 

-0.7 

.470 

10 

22 

-1.5 

.131 

-0.3 

.748 

12.5 

22 

-1.4 

.149 

-0.8 

.399 

16 

22 

-0.1 

.952 

-0.2 

.842 

20 

22 

-1.0 

.317 

-0.2 

.807 

Symbols 

8 

22 

-1.0 

.307 

-0.7 

.470 

10 

22 

-1.5 

.131 

-0.3 

.748 

12.5 

22 

-1.4 

.149 

-0.8 

.399 

16 

22 

-0.1 

.952 

-0.2 

.842 

20 

22 

-1.0 

.317 

-0.2 

.807 

2.3.2  The  Effect  of  Colour 
23.2.1  Letters  and  N  umbers 

The  median  and  inter  quartile  range  of  error  and  certainty  for  each  colour  of  letters  and 
numbers  at  each  character  height  is  shown  in  Table  3.  Friedman  tests  of  the  probability  of 
equal  categories  were  performed  to  assess  the  effect  of  colour  on  error  and  certainty  of 
identification  for  letters  and  numbers,  and  the  results  are  shown  in  Table  4.  There  was  no 
si  gni  fi  cant  effect  of  col  our  on  error  at  any  character  hei  ght.  H  owever,  the  strong  ceiling  effect 
evident  in  the  error  results  may  have  reduced  the  sensitivity  of  the  tests.  Colour  had  a 
si  gni  fi  cant  effect  on  i  dentif  i  cati  on  certai  nty  for  I  etters  w  i  th  hei  ghts  8  mi  n,  10  mi  n  and  16  mi  n, 
and  for  numbers  with  a  height  of  8  min.  Red  was  identified  with  lower  certainty  than  white, 
green  or  cyan. 

Thus,  due  to  it  being  identified  with  lower  certainty,  red  may  have  been  more  difficult  to 
i  dentify  than  the  other  col  ours.  The  effect  was  not  strong  enough  to  transl  ate  i  nto  an  effect  on 
accu  racy,  how  ever  i  ts  i  nf  I  u  ence  on  certai  nty  su  ggests  that  red  shou  I  d  be  avoi  ded  for  I  etters  or 
numbers  unless  the  text  colour  will  also  be  used  to  convey  information.  The  result  that 
i  d  enti  f i  cati  on  accu  racy  and  certai  nty  of  cyan  I  etters  and  n  u  mbers  d  i  d  not  d  i  ff er  from  w  h  i  te  or 
green  indicates  that  the  use  of  cyan  may  overcome  the  problems  previously  identified  with 
the  use  of  pureblueon  LCDs  (Fletcher  etal.,  2009). 
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Table 3:  M  edian  error  and  certainty  for  stimulus  colour  for  letters  and  numbers  at  all  character 
heights.  The  inter-quartile  range  is  in  parentheses. 


Character  Height 

Errors 

(min) 

White 

Red 

Green 

Cyan 

Letters 

8 

0.0% 

(2.5%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(2.5%) 

10 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

12.5 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

16 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

Numbers 

8 

0.0% 

(0.0%) 

(0.0%) 

(10.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

10 

0.0% 

(0.0%) 

(0.0%) 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

12.5 

0.0% 

(0.0%) 

(0.0%) 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

16 

0.0% 

(0.0%) 

(0.0%) 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

20 

0.0% 

(0.0%) 

(0.0%) 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

Character  Height  Certainty 


(min) 

White 

Red 

Green 

Cyan 

Letters 

8 

60.0% 

(72.5%) 

40.0% 

(52.5%) 

60.0% 

(52.5%) 

55.0% 

(65.0%) 

10 

90.0% 

(30.0%) 

70.0% 

(32.5%) 

90.0% 

(22.5%) 

90.0% 

(42.5%) 

12.5 

100.0% 

(20.0%) 

90.0% 

(10.0%) 

100.0% 

(20.0%) 

100.0% 

(10.0%) 

16 

100.0% 

(10.0%) 

100.0% 

(12.5%) 

100.0% 

(0.0%) 

100.0% 

(2.5%) 

20 

100.0% 

(2.5%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

Numbers 

8 

75.0% 

(50.0%) 

50.0% 

(50.0%) 

80.0% 

(42.5%) 

70.0% 

(41.4%) 

10 

90.0% 

(20.0%) 

100.0% 

(20.0%) 

95.0% 

(10.0%) 

100.0% 

(15.8%) 

12.5 

100.0% 

(2.5%) 

100.0% 

(10.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

16 

100.0% 

(0.0%) 

100.0% 

(2.5%) 

100.0% 

(2.5%) 

100.0% 

(0.0%) 

20 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

T  able  4:  R  esults  of  Friedman  tests  to  assess  whether  colour  had  a  significant  effect  on  identification 

error  and  certainty  for  letters  and  numbers.  *  indicates  p  <  .05,  **  indicates  p  <  .01. 


Character  Height 
(min) 


df 


Errors 
Chi- 
Square 


Certainty 
Chi- 
Square 


Letters 

8 

10 

12.5 

16 

20 

3 

3 

3 

3 

3 

5.5 

2.0 

3.0 

2.0 

.141 

.572 

.392 

.570 

1.000 

9.8 

14.4 

6.1 

8.0 

0.7 

.020  * 
.002  ** 
.106 
.047  * 
.864 

Numbers 

8 

3 

5.6 

.132 

10.8 

.013  * 

10 

3 

3.8 

.290 

1.6 

.662 

12.5 

3 

2.0 

.572 

2.6 

.459 

16 

3 

1.4 

.706 

1.1 

.776 

20 

3 

3.0 

.392 

3.0 

.392 

2.3. 2.2  Symbols 

Symbols  were  presented  either  in  white,  whereonly  shapecould  beused  for  identification,  or 
colour-coded,  where  their  colour  also  contributed  to  identification.  The  median  and  inter 
quarti  I  e  range  of  error  and  certainty  for  monochrome  and  colour-coded  symbols  is  shown  in 
Table  5.  Wilcoxon  sign  rank  order  comparison  tests  were  used  to  assess  the  effect  of  colour 
coding  on  identification  accuracy  and  certainty,  and  the  results  are  shown  in  Table  6. 
Identification  accuracy  was  significantly  higher  for  coloured-coded  symbols  than 
monochrome  symbols  for  character  heights  of  8  min  and  10  min.  Identification  certainty  was 
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significantly  higher  for  colour-coded  symbols  than  monochrome  symbols  for  all  character 
heights  less  than  20  min. 

In  contrast  to  the  result  that  colour  had  no  effect  on  identification  accuracy  of  letters  and 
numbers,  the  use  of  colour  coding  had  a  reliable  and  robust  effect  on  the  identification 
accuracy  of  symbols.  Thus  it  appears  that  the  use  of  redundant  colour  coding  provided 
additional  information  which  assisted  in  the  accuracy  and  certainty  at  which  symbols  were 
identified. 


Table 5:  M  edian  error  and  certainty  for  monochrome  and  colour-coded  symbols  at  each  character 
height.  T he  inter-quartile  range  is  in  paren  theses. 


Character  Height 
_ (min) _ 


Errors 


Monochrome 


Colour  Coded 


Monochrome 


Certainty 


Colour  Coded 


8 

10.4% 

(8.3%) 

0.0% 

(1.0%) 

54.4% 

(62.5%) 

83.3% 

(32.3%) 

10 

4.2% 

(9.4%) 

0.0% 

(0.0%) 

66.7% 

(37.5%) 

95.7% 

(26.0%) 

12.5 

0.0% 

(1.0%) 

0.0% 

(0.0%) 

93.8% 

(20.8%) 

95.8% 

(10.4%) 

16 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

95.8% 

(26.0%) 

100.0% 

(4.2%) 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

100.0% 

(24.6%) 

100.0% 

(4.2%) 

T able  6:  R  esults  ofWilcoxon  Sign  R  ank  tests  to  assess  whether  colour-coding  had  a  significant  effect 
on  symbols.  *  indicates  p  <  .05,  **  indicates  p  <  .01,  ***  indicates  p  <  .001. 


Character  Height 
(min) 

df 

Errors 

Z  p 

Certainty 

Z  p 

8 

m 

-4.1 

<001  *** 

-4.0  <.001  *** 

10 

n 

-3.3 

0.001  *** 

-4.0  <.001  *** 

12.5 

n 

-1.3 

0.206 

-2.6  .009  ** 

16 

ES 

-1.7 

0.084 

-2.4  .018  * 

20 

i 

-1.7 

0.083 

-1.9  .058 

2.3.3  The  Effect  of  Display  Time 

All  the  previous  results  relate  to  a  stimulus  display  time  of  106  ms.  As  an  empirical  test  of 
whether  a  display  time  of  106  ms  placed  too  stringent  a  limit  on  visual  processing,  a  173  ms 
display  time  condition  was  tested  for  white  letters  only.  This  display  time  was  chosen  as  it 
approaches  thedurati  on  of  an  average  fixation.  Wilcoxon  sign  ranks  tests  were  performed  to 
determi  ne  if  the  character  hei  ght  at  w  hi  ch  errors  and  certai  nty  became  si  gni  fi  cantl  y  d  i  fferent 
from  the  maxi  mu  m  character  si  ze  d  i ffered  betw een  the  tw o  d  i  sp I  ay  ti  me  cond  i  ti  ons.  P I  ots  of 
median  error  and  certai  nty  at  each  stimul  us  heightfor  both  display  ti  me conditi ons  areshown 
in  Figure4,  and  the  results  of  the  Wilcoxon  signed  ranks  tests  are  shown  inTable7.  These 
show  that,  between  the  two  display  time  conditions,  there  was  no  reliable  difference  in  the 
character  height  at  which  errors  or  certainty  became  significantly  different  from  error  and 
certai  nty  at  the  maxi  mu  m  character  hei  ght.  This  suggests  that  the  resu  I  ts  of  the  short  d  i  spl  ay 
time  for  the  other  stimulus  types  can  be  considered  representative  of  performance  under 
natural  viewing  conditions. 
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Figured:  Plots  of  median  identification  error  and  certainty  for  white  letters  at  each  stimulus  height 
for  a  106  ms  and  a  173  ms  display  time.  E rror  bars  represent  the  75th  percentile  range. 


Table 7:  Results  of  Wilcoxon  signed  ranks  tests  to  determine  the  character  height  at  which 
identification  error  and  certainty  significantly  differed  from  themaximum  character  height 
for  white  letters  at  display  time  of  106  ms  and  a  173  ms.  *  indicates  p  <  .05,  **  indicates 
p  <.01,  *** indicates p  <.001. 


Character  Height 
(min) 

df 

Display  Time 

106  ms 

Z  P 

173  ms 

Z  P 

8 

1 

-2.4 

.014  * 

2.1 

.039  * 

10 

1 

0.0 

1.000 

0.0 

1.000 

Errors 

12.5 

1 

-1.0 

.317 

0.0 

1.000 

16 

1 

0.0 

1.000 

0.0 

1.000 

8 

1 

-3.9 

<  ooi  *** 

4.2 

<  ooi  *** 

10 

1 

-3.3 

.001  ** 

3.0 

.003  ** 

Certainty 

12.5 

1 

-1.8 

.075 

1.7 

.089 

16 

1 

-1.9 

.061 

1.4 

.161 

2.3.4  The  Effect  of  Size 

The  primary  goal  ofthisstudy  wastodeterminetheminimumtextand  symbol  sizethat  could 
be  accurately  and  confidently  identified  when  viewed  for  a  brief  period.  The  mini  mum  size 
was  calculated  as  the  smallest  size  where  the  percentage  of  responses  in  error  and  the 
percentage  of  'completely  certain'  responses  did  not  significantly  differ  from  the  maximum 
character  height  of  20  min.  Twenty  minutes  of  arc  was  chosen  as  the  maximum  character 
hei  ght  as  i  t  w as  the  p referred  hei  ght  for  bl  ack  and  w  h i  te  characters  and  cl  ose to  the  mi  n i  mu m 
heightfor  coloured  characters  in  Ml  L-STD-1472F  (DoD,  1999a).  Relative,  rather  than  absolute, 
measures  of  accuracy  and  certainty  were  used  to  allow  for  the  possible  situation  that  the 
identification  or  certainty  may  not  be  perfect  at  the  maxi  mum  height.  Plots  of  the  median  and 
75th  percenti  I  e  range  of  the  percentage  of  responses  i  n  error  and  the  percentage  of  'compl  etel  y 
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certain' for  letters,  numbers  and  symbols  are  shown  in  Figure5.  Wilcoxon  signed  ranks  tests 
were  used  to  determine  the  character  heights  at  which  errors  and  certainty  became 
si  gni fi  cantl  y  I  ower  than  at  a  character  hei  ght  of  20  mi  n.  Tabl  e  8  shows  the  resu I ts  of  each  test 
for  the  short  di  spl  ay  ti  me. 


Stimulus  Height  (min) 


Figure 5:  Plots  of  median  error  and  certainty  at  each  stimulus  height  for  letters  and  numbers  (top 
row)  and  monochrome  and  colour-coded  symbols  (bottom  row).  Error  bars  represent  the 
75th  percentile  range. 
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Table8:  Results  of  Wilcoxon  sign  ranks  tests  performed  at  each  character  height  to  determine 
whether  errors  and  certainty  were  significantly  lower  than  at  the  maximum  character 
height  of  20  min.  *  indicates  p  <  .05,  **  indicates  p  <  .01,  ***  indicates  p  <  .001. 


Character  Height  (min) 

df 

Errors 

Z  p 

Certainty 

Z  p 

8 

1 

-2.8 

.005  ** 

-3.0 

<  ooi  *** 

Letters 

10 

1 

-1.3 

.180 

-4.0 

<  ooi  *** 

(All  Colours) 

12.5 

1 

-1.0 

.317 

-3.1 

.002  ** 

16 

1 

-1.3 

.180 

-2.3 

.023  * 

8 

1 

-3.0 

.003  ** 

-4.2 

<  ooi  *** 

Numbers 

10 

1 

-1.7 

.096 

-3.5 

<  ooi  *** 

(All  Colours) 

12.5 

1 

-0.8 

.414 

-1.9 

.062 

16 

1 

-0.8 

.414 

-1.5 

.124 

8 

1 

-4.1 

<  ooi  *** 

-4.3 

<  ooi  *** 

Monochrome 

10 

1 

-3.4 

.001  ** 

-4.0 

<  ooi  *** 

Symbols 

12.5 

1 

-1.2 

.248 

-2.8 

.005  ** 

16 

1 

-1.1 

.271 

-2.1 

.033  * 

8 

1 

-2.4 

.014  * 

-4.0 

<  ooi  *** 

Colour-Coded 

10 

1 

-2.2 

.025  * 

-3.1 

.002  ** 

Sumbols 

12.5 

1 

-1.7 

.083 

-2.4 

.016  * 

16 

1 

-1.0 

.317 

-0.7 

.465 

From  Table  8  it  can  be  seen  that,  in  order  to  avoid  an  increase  in  error  rates,  letters  and 
numbers  needed  to  have  a  height  of  10  min  or  greater,  and  both  monochrome  and  colour- 
coded  symbols  needed  to  have  a  height  or  12.5  min  or  greater.  The  sizes  necessary  to  maintain 
i  dentifi  cati  on  certai  nty  were  always  hi  gher  than  necessary  to  mai  ntai  n  i  dentifi  cati  on  accuracy. 
Therewas  a  statistically  significant  decrement  in  certainty  for  letters  and  monochrome  white 
symbols  I  ess  than  20  min  high,  for  numbers  less  than  12.5  min  height  and  for  colour-coded 
symbols  I  ess  than  16  min  high. 

Thus  the  two  measures  lead  to  somewhat  diverging  conclusions  as  to  the  minimum 
acceptabl  e  sti  mu  I  u  s  hei  ght.  E  rrors  i  n  i  d  enti  f  i  cati  on  are  a  cl  ear  i  nd  i  cati  on  that  parti  ci  pants  had 
difficulty  in  processing  the  stimuli,  and  the  results  suggest  that  letters  and  numbers  should 
have  a  minimum  height  of  10 min,  whereas  symbols  should  have  a  minimum  height  of 
12.5  min.  A  reduced  certainty  of  identification  also  suggests  that  participants  had  difficulty 
processing  thestimuli,  and  certainty  was  affected  atlarger  character  heights  than  accuracy.  It 
i  s  d  i  ff i  cu  1 1  to  pred  i  ct  the  magn i  tu d e  of  the  effect  of  i  d enti f  i  cati  on  certai  nty  on  i  d enti f i  cati  on 
speed,  but  an  i  nspection  of  the  certai  nty  pi  ot  i  n  Figure  5  shows  that  certai  nty  tends  to  drop  off 
more  rapidly  for  stimulus  heights  below  12.5  min  than  it  does  at  12.5  min  and  above.  Thus 
while  letters  and  numbers  must  have  a  height  of  10 min  or  greater  to  maintain  accuracy 
performance,  it  appears  that  they  should  have  a  height  of  12.5  min  or  greater  to  maintain 
i  dentifi  cati  on  certai  nty .  1 1  al  so  appears  that  symbol  s  must  have  a  hei  ght  of  12.5  mi  n  or  greater 
to  maintain  both  identification  accuracy  and  certainty  performance.  This  size  range  of 
10- 12.5  min  is  in  close  agreement  with  the  results  of  a  related  study  which  estimated  that 
critical  reading  speed  would  be  achieved  ata  letter  hei  ght  of  approximately  11  min  using  the 
same  ambient  lighting  and  character  luminance  conditions  (Fletcher  et  al.,  2009).  This 
agreement  suggests  that  the  experimental  method  of  the  current  study  is  ableto  provide  a 
valid  indication  of  the  character  size  necessary  to  achieve  maximum  reading  speed. 
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3.  Experiment  2- At  Sea 


3.1  Introduction 

TheCMSdisplaysneed  tobeused  at  sea  where,  particularly  during  high  sea  states,  the  ship's 
motion  may  have  an  affect  on  human  visual  and  cognitive  performance.  It  is  known  that  ship 
motion  can  induce  motion  sickness  and  can  cause  fatigue  due  to  interrupted  sleep  and 
increased  energy  expenditure  necessary  to  maintain  balance  (Dobie,  2003;  Smith,  2001).  The 
ai  m  of  Experi  ment  2  was  to  exami  ne  whether  the  mi  ni  mum  text  and  symbol  hei  ghts  found  i  n 
Experi  ment  1  need  to  be  adjusted  to  account  for  the  possi  ble  detri  mental  effects  of  an  at-sea 
environment.  Experiment  2  replicated  the  procedure  of  Experiment  1,  but  used  only  white 
letters  and  low  ambient  lighting.  It  was  conducted  as  part  of  a  larger  international  study 
investigating  the  relationship  between  ships  motion,  sea-sickness,  fatigue  and  cognitive 
performance  during  a  12  day  sea  trial  conducted  off  the  coast  of  N  ova  Scotia,  Canada. 

Experiment  2  was  conducted  four  times  during  the  sea  trial,  using  the  following  testing 
schedule: 

•  Session  1:  Pre-deployment,  alongside. 

•  Sessi on  2: 4th  day  out,  open  seas.  Potenti al ly  hi gh  sea  states. 

•  Session  3:  8th  day  out,  open  seas.  Potentially  high  sea  states. 

•  Session  4: 10th  day  out,  at  anchor  in  sheltered  bay.  Calm  conditions  expected. 

Session  1  was  expected  to  provide  baseline  results  under  calm  conditions.  The  subsequent 
sessi  ons  woul  d  be  used  to  i  dentify  the  possi  bl  e  effect  of  the  at-sea  envi  ronment.  The  protocol 
anti  ci  p ated  th at  i  f  h  i  g h  seas  w  ere  en cou  ntered  d  u  r i  ng  th e  tr i  al ,  th  i  s  may  I  ead  to  f ati  g u  e  bu  i  I  d 
up  during  thevoyage.  Italso  identified  that  sea-sickness  may  beprevalentduringthefirsthalf 
of  the  voyage,  but  reduce  in  the  second  half  due  to  habituation  to  ship  motions.  Thus  the 
results  of  either  Sessi  on  2  or  Session  3  may  bedegraded  compared  to  Session  1.  The  results  of 
each  session  were  analysed  to  assess  whether  identification  errors  or  certainty  varied  across 
the  sessi  ons  and  to  identify  the  worst  case  sessi  on  as  representative  of  performance  in  an  at- 
sea  environment.  The  results  of  this  session  could  then  be  compared  with  the  results  of 
Experi  ment  1  to  establ  i  sh  w  hether  the  mi  ni  mu m  character  hei  ght  resul  ts  obtai  ned  i  n  the  on- 
land  environment  of  Experiment  1  need  to  be  adjusted  to  apply  to  an  at-sea  environment. 

A  repeated-measures  design  was  used  for  Experiment  2  and  the  absence  of  a  control  group 
meant  that  it  was  not  possi  ble  to  separate  such  variables  as  fatigue  and  ship  motion  effects 
from  the  potential  learning  or  practice  effects.  However,  as  the  task  focused  on  the 
i  d  enti  f  i  cati  on  of  I  etters,  w  h  i  ch  i  s  al  ready  h  i  ghl  y  p  racti  ced ,  i  t  w  as  consi  d  ered  that  the  effects  of 
the  repeated  administration  of  the  test  would  not  be  large. 
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3.2  Method 

3.2.1  Participants 

Twelve  volunteers,  aged  between  18  and  44  with  an  average  age  of  29.8  years  (SD  =8.8years), 
were  recruited  for  the  trial  from  the  Canadian  Armed  Forces  regular  and  reserve  personnel . 
Nine  were  male,  three  were  female. 

3.2.2  Apparatus 

The  experiment  was  run  on  a  Sony  VAIO  model  PCG-4E3P  notebook.  It  had  a  10.6"  LCD 
screen  with  a  resolution  of  1280x  768  pixels. 

3.2.3  Stimulus 

Only  white  letters  were  used  in  this  experiment.  The  Sony  VAIO  laptop  had  a  lower 
resolution  than  thescreen  used  in  Experiments  but  an  equivalent  apparent  pixel  density  was 
achieved  by  doubling  the  height  and  width  of  the  Experiment  1  stimuli  and  increasing  the 
viewing  distance  to  1070mm.  Thus  the  stimuli  had  an  equivalent  number  of  pixels  and 
subtended  the  same  visual  angles  as  in  Experiment  1.  The  stimuli  were  displayed  over  a 
screen  background  luminance  of  1  ±  0.2  cd/  m2. 

3.2.4  Procedure 

The  study  was  conducted  in  a  forward,  port  side  cabin  on  board  the  Canadian  Forces 
Auxiliary  Vessel  Quest.  The  cabin  allowed  for  controlled  ambient  lighting  conditions  of 
approxi  mately  1.5 1  ux.  Each  experi  mental  sessi  on  consi sted  of  100 tri al  s  (5  si zes  x  10 1  etters  2 
display  times)  and  was  identical  in  process  to  that  of  Experiment  1.  Each  participant 
performed  10  p  racti  ce tr i  al  s  at  th e  beg i  n n  i  ng  of  the  sessi  on ,  w  h  i  ch  p resented  each  of  th e  I  etters 
over  the  range  of  si  zes  to  be  tested.  Each  experimental  sessi  on  took  approximately  15  minutes, 
i  nd  udi  ng  a  10  mi  nute  vi  sual  adaptati  on  peri  od  at  the  start  of  each  sessi  on.  At  thestart  of  each 
session,  each  participant  completed  the  Misery  Scale,  in  which  participants  are  asked  to 
identify  their  current  level  of  motion  sickness  on  a  11-point  scale  with  anchors  of  0  -  no 
symptoms,  1  -  stuffy  or  uneasy  feel  i  ng  i  n  the  head,  3  -  stomach  di  scomfort,  5  -  nauseated,  7  - 
very  nauseated,  9-  retching  and  10-  continuous  vomiting  (Wertheim,  DeGroene,  &  Oooms, 
1995;  Wertheim,  Oooms,  DeRegt,  &  Wientjes,  1992).  Data  on  ships  motion  was  also  collected 
during  each  experimental  session. 

Participants  were  seated  at  a  viewing  distance  of  1070  mm  from  the  screen,  facing  aft.  The 
experi  mental  configuration  did  not  allow  for  the  use  of  a  chin  rest,  and  so  ships  motion 
caused  some  vari  ati  on  i  n  vi  ewi  ng  di  stance.  FI  owever,  an  experi  menter  sat  with  parti  ci  pants  i  n 
all  sessions  and  ensured  that  participants  did  not  appreciably  change  the  viewing  distance. 

Four  experimental  sessi  onswereconducted  according  to  thescheduledescri  bed  in  section  3.1. 
Each  participant  participated  in  all  sessions. 
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3.3  Results  and  Discussion 

Errors  and  self-reported  certai  nty  were  col  I  ected  for  each  tri  al .  Tri  al  s  w  here  'Compl  ete  G  uess' 
was  recorded  were  removed  from  the  analysis.  This  occurred  for  84  (1.8%)  of  the  4,800  trials. 
For  each  participant,  the  percentage  of  trials  with  errors  and  the  percentage  of  trials  with 
'completely  certai  n'  responses  were  calculated  for  each  condition.  Accuracy  and  certainty  data 
were  highly  skewed,  with  very  few  errors  made  in  any  size  except  the  smallest,  and 
participants  responding  'completely  certain'  in  most  trials  with  larger  stimulus  sizes.  Thus 
non-parametric  tests  of  the  median  of  individual  subject  percentage  errors  and  certainty  were 
used  in  the  analysis.  A  threshold  significance  level  ofp  =.05  was  used. 

The  error  and  certainty  results  for  each  experi  mental  session  are  shown  inTable9.  Plots  of  the 
motion  data  are  shown  Figure  6.  The  results  of  the  misery  scale  are  not  reported,  as 
participants  generally  reported  zero  scores  (no  problems  at  all)  for  all  sessions.  One 
participant  reported  a  score  of  1  (uneasy,  no  typical  symptoms)  for  both  Session  2  and 
Session  3,  and  one  participant  reported  a  score  of  3  (slight  dizziness,  warmth,  headache, 
stomach  awareness  or  sweating,  but  no  nausea).  Three  aspects  of  the  data  were  analysed: 
(1)  differences  between  th e  experimental  sessions,  (2)  the  effect  of  viewing  time  and  (3)  the 
letter  heights  at  which  accuracy  and  certainty  were  affected  under  the  short  viewing  time 
conditions. 


T able  9:  M  edian  error  and  certainty  for  white  letters  at  both  106  ms  and  1 73  ms  viewing  times  for 
each  character  height  for  each  session  of  Experiment  2.  The  inter-quartiie  ranges  are  in 
parentheses. 


Character  Height 

Experimental  Session 

(min) 

Session  1 

Session  2 

Session  3 

Sessi 

on  4 

8 

10.6% 

(23.3%) 

20.0% 

(26.3%) 

10.0% 

(6.9%) 

10.6% 

(17.5%) 

10 

0.0% 

(12.5%) 

0.0% 

(2.8%) 

5.0% 

(10.0%) 

0.0% 

(0.0%) 

Error 

12.5 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(10.0%) 

0.0% 

(10.0%) 

106  ms 

16 

0.0% 

(0.0%) 

0.0% 

(10.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

nic  r\low 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

uibpidy 

8 

78.9% 

(32.5%) 

85.0% 

(31.3%) 

100.0% 

(52.5%) 

86.7% 

(33.6%) 

Time 

10 

100.0% 

(12.5%) 

100.0% 

(13.9%) 

100.0% 

(32.5%) 

100.0% 

(20.0%) 

Certainty 

12.5 

100.0% 

(10.0%) 

100.0% 

(12.5%) 

95.0% 

(32.5%) 

100.0% 

(11.1%) 

16 

100.0% 

(0.0%) 

100.0% 

(10.0%) 

100.0% 

(0.0%) 

100.0% 

(10.0%) 

20 

100.0% 

(0.0%) 

100.0% 

(2.5%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

8 

10.0% 

(13.3%) 

0.0% 

(12.5%) 

5.0% 

(10.0%) 

0.0% 

(10.0%) 

10 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(10.0%) 

0.0% 

(0.0%) 

Error 

12.5 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(10.0%) 

1 73  ms 

16 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

Hicnlsw 

20 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

L/lo  JJIdy 

8 

85.0% 

(20.0%) 

95.0% 

(52.5%) 

95.0% 

(35.0%) 

100.0% 

(29.2%) 

Time 

10 

100.0% 

(12.5%) 

100.0% 

(12.5%) 

95.0% 

(30.0%) 

100.0% 

(2.5%) 

Certainty 

12.5 

100.0% 

(10.0%) 

100.0% 

(10.6%) 

100.0% 

(10.0%) 

100.0% 

(10.0%) 

16 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

20 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0% 

(0.0%) 
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Pitch  and  Roll  Motion  Data 


Vertical  Acceleration  Data 


Day  at  Sea 


Figure6:  Plots  of  horizontal  and  vertical  RMS  roll  and  pitch  and  vertical  acceleration  over  the 
duration  of  the  trial.  The  vertical  lines  indicate  when  the  test  sessions  were  performed. 


3.3.1  Differences  between  Experimental  Sessions 

A  Fri  edman  test  of  probabi  I  ity  of  equal  categori  es  was  performed  at  each  character  hei  ght  to 
assess  whether  there  was  any  effect  of  sessi  on  on  i  dentifi  cati  on  error  or  certai  nty  performance. 
The  resu  I  ts  show  n  i  n  Tabl  e  10  show  that  the  experi  mental  sessi  on  onl  y  had  a  si  gnifi  cant  effect 
on  errors  for  a  character  height  of  16  min.  Thus  the  experimental  session  did  not  appear  to 
have  a  reliable  effect  on  error  or  certainty.  It  is  not  clear  why  this  was  the  case.  It  may  have 
been  because  the  ship's  motion  was  not  consistently  above  heuristic  thresholds  necessary  to 
induce  adverse  effects,  but  it  should  also  be  noted  that  a  sample  size  of  12  may  not  provide 
enough  power  to  yield  statistically  significant  results.  Given  these  results,  the  data  from 
Sessions  2  and  3  were  combined  into  an  "at-sea"  condition  for  further  analysis. 

Tabl  el  0:  Results  of  Fri  edman  tests  to  exami  nethe  effect  of  experi  men  tal  sessi  on  on  i  den  ti  fi  cati  on 
error  or  certainty.  *  indicates  p  <  .05. 


Character  Height 
(min) 

df 

Errors 

Chi- 

Square 

P 

Certainty 

Chi- 

Square  p 

8 

3 

0.8 

.856 

4.4 

.219 

10 

3 

5.0 

.172 

0.3 

.952 

12.5 

3 

3.2 

.357 

4.2 

.243 

16 

3 

9.0 

.029  * 

4.3 

.228 

20 

3 

1.0 

.081 

1.9 

.585 

3.3.2  The  Effect  of  Letter  Size  and  Display  Time 

Having  determined  that  combining  data  from  Sessions  2  and  3  would  best  generalise  the 
target  population  of  naval  combat  system  operators  under  at-sea  operational  conditions,  the 
effect  of  letter  height  on  accuracy,  certainty  and  response  time  for  data  from  these  sessions 
were  exami  ned .  As  di  scussed  i  n  the  i  ntroducti  on,  convi  nci  ng  evi  dence  exi  sts  that  the  vi  sual 
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i  nformati  on  necessary  to  reach  an  i  dentifi  cati  on  deci  si  on  i  s  col  I  ected  withi  n  thefi  rst  100  ms  of 
viewing.  However,  fixations  generally  have  an  average  duration  of  approximately  200  ms, 
and  it  isthoughtthat  it  is  possiblefor  information  to  be  processed  throughout  the  fixation 
period.  Thus  it  may  be  possible  to  maintain  reading  speeds  while  processing  information  at 
the  fixation  point  for  longer  than  100ms.  To  explore  this,  the  effect  of  text  size  on 
identification  performance  of  white  letters  was  examined  for  display  time  conditions  of 
106  ms  and  173  ms. 
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Figure  7:  Plots  of  median  identification  error  and  certainty  for  white  letters  at  each  stimulus  height 
for  a  106  ms  and  a  173  ms  display  time  during  combined  at-sea  test  sessions.  Error  bars 
represent  the  75th  percentile  range. 


Table  11:  Results  of  Wilcoxon  signed  ranks  tests  to  determine  the  character  height  at  which 
i  den  ti  fi  cati  on  error  an  d  certai  n  ty  for  white!  etters  si  gn  i  fi  can  tly  di  ffered  from  the  maxi  mum 
character  height  for  106  ms  and  173  ms  display  times  using  the  combined  at-sea  test 
sessions.  *  indicates  p  <  .05. 


Character  Height 

,  ,  df 

(min 


Display  Time 

106  ms  173  ms 

Z  P_ Z  p 


Errors 


Certainty 


8.0 

1 

-2.9 

.005  ** 

-2.3 

.024  * 

10.0 

1 

-2.4 

.017  * 

-1.5 

.131 

12.5 

1 

-2.2 

.026  * 

-1.1 

.257 

16.0 

1 

-1.2 

.223 

-0.6 

.564 

8.0 

1 

-2.5 

.011  * 

-2.3 

.021  * 

10.0 

1 

-1.8 

.080 

-1.8 

.068 

12.5 

1 

-2.4 

.018  * 

-1.9 

.056 

16.0 

1 

-0.1 

.891 

-1.6 

.102 

As  seen  in  Table  11,  the  different  display  times  led  to  different  character  heights  at  which 
identification  error  and  certainty  became  significantly  different  from  that  of  the  maximum 
character  hei  ght.  For  the  106  ms  d  i  spl  ay  ti  me  cond  i  ti  on,  I  etter  hei  ghts  of  12.5  mi  n  and  bel  ow 
had  significantly  more  errors  when  compared  to  the  maxi  mum  character  height  of  20  min. 
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C  ertai  nty  w  as  al  so  si  gn  i  f  i  cantl  y  I  ow  er  than  at  the  maxi  mumheightforl  etter  hei  ghts  of  8  mi  n 
and  12.5  min.  This  result  would  suggest  that  white  letters  should  have  a  minimum  height  of 
16  min  to  optimise  visual  identification  performance  at  sea.  For  the  173  ms  display  time 
condition,  only  letters  with  a  height  of  8 min  had  error  and  certainty  rates  that  were 
significantly  different  from  the  maximum  letter  height.  However  an  inspection  of  Figure  7 
i  n  d  i  cates  th  at  ev  en  w  i  th  th  i  s  exten  deddisplaytimeatrendtowardsdegradedidentification 
performance  was  evident  for  letter  heights  lower  than  16  min. 

The  mini  mum  letter  height  results  vary  between  Experiments  land  2,  and  this  could  be  due 
to  differences  in  the  nature  of  the  samples  or  the  testing  environment.  Given  that  both  the 
participants  and  environmental  conditions  of  Experiment  2  are moredosely  aligned  with  the 
operational  conditions  under  which  thecombat  management  systemwill  beused,  itcould  be 
argued  that  the  results  of  Experiment  2  should  take  precedence.  However,  in  addition  to  the 
different  participant  samples  and  testing  environments,  a  different  display  screen  was  also 
used  in  each  study.  Experiment  1  used  a  LCD  similar  to  that  proposed  for  use  in  a  combat 
management  system  console  but  Experiment  2  used  a  laptop  with  a  display  which  was 
smaller  and  had  lower  resolution.  The  different  screens  may  have  contributed  to  the 
differences  between  Experiment  1  and  Experiment  2;  to  address  this  concern  a  third 
experi  ment  was  conducted  i  n  whi  ch  a  subset  of  Experi  ment  1  parti  ci  pants  was  retested  usi  ng 
the  apparatus  and  procedure  of  Experi  ment  2. 


4.  Experiment  3 -Comparison  of  Screens 

4.1  Introduction 

Experi  ment  2  was  conducted  with  a  different  sampl  eof  parti  ci  pants  who  performed  thetests 
in  a  different  environment  and  on  a  different  screen  than  used  in  Experiment  1.  Both  the 
sampleand  environment  of  Experi  ment  2  are  closer  to  the  actual  population  and  environment 
that  the  CMS  displays  will  beused  in  and  thus  the  results  of  Experiment  2  potentially  have 
greater  external  validity  than  those  of  Experiment  1.  The  reverse  was  true  for  the  display 
screens,  with  Experiment  1  using  a  display  that  is  similar  to  that  proposed  for  use  in  a  CM  S 
and  Experiment  2  using  a  laptop  with  lower  resolution.  Although  the  stimulus  size  and 
viewing  distance  in  Experi  ment  2  were  adjusted  to  create  an  equivalent  pixel  density  to  that  of 
Experiment  1,  the  possi  bi  I  ity  exists  that  thedifferent  displays  were  causing  thedifferences  in 
minimum  acceptable  character  heights  seen  between  Experiment  1  and  2.  To  address  these 
concerns,  a  final  Experiment  was  performed  in  which  the  participants  of  Experiment  1  who 
experienced  the  ambient  light  and  screen-background  luminance  conditions  used  in 
Experiment  2  and  were  still  available  were  re-tested  using  the  apparatus  and  procedure  of 
Experiment  2.  If  a  significant  difference  was  found  between  the  two  Experiments,  it  would 
suggest  that  the  screen  may  have  i  nfl  uenced  the  results  of  Experiment  2. 
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4.2  Method 

4.2.1  Participants 

N  i  ne  of  the  parti  ci  pants  who  were  tested  under  dark  ambi  ent  I  i  ghti  ng  i  n  Experi  ment  1  were 
availableto  parti  cipatein  Experiment  3.  Fiveof  the  participants  were  maleand  the  average 
age  of  the  participants  was  34.1years  (SD  =6.0). 

4.2.2  Apparatus 

The  same  equipment  as  in  Experiment  2  was  used. 

4.2.3  Stimulus 

The  stimuli  of  Experiment  2  were  used. 

4.2.4  Procedure 

The  same  procedure  as  Experiment  2  was  used,  with  theexcepti  on  that  only  oneexperi  mental 
session  was  conducted  for  each  participant.  All  participants  were  tested  under  dark  ambient 
lighting  (1.5  lux  measured  above thedisplay). 

4.3  Results  and  Discussion 

The  mean  percentage  of  error  and  "Completely  Certain"  responses  for  each  letter  height  for 
the  participants  common  to  both  Experiment  1  and  3  is  shown  in  Table  12,  and  plots  of  the 
certainty  results  are  shown  in  Figure  8.  Wilcoxon  signed  ranks  tests  were  performed  to 
determine  the  character  height.  At  which  the  percentage  of  "completely  certain"  responses 
became  reliably  di  fferent  from  the  percentage  of "  compl  etel  y  certai  n  "  responses  observed  at  a 
character  hei  ght  of  20  mi  n.  The  results  of  these  tests  are  shown  i  n  T able  13. 

Tablel2:  M  edian  percentage  of  error  and  "Completely  Certain"  responses  for  white  letters  at  each 
display  time  for  Experiment  1  (DSTO  sample,  Apple  LCD  monitor)  and  Experiment  3 
(DSTO  sample,  Sony  VAIO  LCD  monitor).  The  inter-quartile  range  is  in  parentheses. 

Character  1 06  ms  Display  Time  1 73  ms  Display  Time 


Height  (min) 

Experiment  1 

Experiment  3 

Experiment  1 

Experiment  3 

8.0 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0%  (0.0%) 

0.0%  (10.0%) 

10.0 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0%  (0.0%) 

0.0% 

(0.0%) 

Errors 

12.5 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0%  (0.0%) 

0.0% 

(0.0%) 

16.0 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0%  (0.0%) 

0.0% 

(0.0%) 

20.0 

0.0% 

(0.0%) 

0.0% 

(0.0%) 

0.0%  (0.0%) 

0.0% 

(0.0%) 

8.0 

60.0% 

(40.0%) 

60.0% 

(50.0%) 

80.0%  (50.0%) 

70.0% 

(50.0%) 

10.0 

90.0% 

(10.0%) 

90.0% 

(20.0%) 

100.0%  (20.0%) 

90.0% 

(10.0%) 

Certainty 

12.5 

100.0% 

(0.0%) 

100.0% 

(10.0%) 

100.0%  (0.0%) 

100.0% 

(0.0%) 

16.0 

90.0% 

(10.0%) 

100.0% 

(0.0%) 

100.0%  (0.0%) 

100.0% 

(0.0%) 

20.0 

100.0% 

(0.0%) 

100.0% 

(0.0%) 

100.0%  (0.0%) 

100.0% 

(0.0%) 
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Stimulus  Height  (min)  Stimulus  Height  (min) 

Figure  8:  Plots  of  median  identification  certainty  for  white  tetters  at  each  stimulus  height,  using  the 
ninepartici pants  common  toExper/mentsl  and  3.Theleftplotisfor  a  106  ms  display  time, 
and  the  right  plot  is  for  a  173  ms  display  time.  Error  bars  represent  the  75th  percentile 
range. 

Table  13:  Results  of  Wilcoxon  signed  ranks  tests  to  determine  the  character  height  at  which 
identification  certainty  for  white  letters  significantly  differed  from  a  character  height  of 
20  min  for  the  common  participants  of  Experiments  1  and  3.  The  table  shows  both  the 
106  ms  and  1 73  ms  display  time  conditions. 


Character 

106  ms  Display  Time 

173  ms  Display  Time 

Height 

Experiment  1 

Experiment  3 

Experiment  1 

Experiment  3 

(min) 

df 

Z 

P 

Z 

P 

Z 

P 

Z 

P 

8.0 

1 

-2.37 

0.018  * 

-2.38 

0.018  * 

-2.54 

0.011  * 

-2.37 

0.018  * 

10.0 

1 

-2.06 

0.039  * 

-2.03 

0.042  * 

-1.63 

0.102 

-2.12 

0.034  4 

12.5 

1 

-0.82 

0.414 

-1.00 

0.317 

-1.00 

0.317 

-1.00 

0.317 

16.0 

1 

-1.67 

0.096 

-1.00 

0.317 

-1.00 

0.317 

0.00 

1.000 

Table  13  shows  that  for  the  participants  common  to  both  Experiment  3  and  Experiment  1, 
there  was  a  significant  reduction  in  identification  certainly  for  character  heights  less  then 
12.5 min  in  106ms  display  time  condition.  In  other  words,  for  both  display  screens, 
i  denti  fi  cati  on  certai  nty  was  affected  at  the  same  character  hei  ght.  For  the  173  ms  d  i  spl  ay  ti  me 
condition,  a  reduction  i  n  certai  nty  was  seen  for  character  heights  below  10  min  for  the  sub-set 
of  Experiment  1  participants  common  to  Experiment  3,  and  for  character  heights  below 
12.5  min  in  Experiment  3.  This  could  be  interpreted  as  indicating  that  the  screen  used  in 
Experiment  3  led  to  lower  identification  certainty.  However,  as  it  is  inconsistent  with  the 
results  of  the  106  ms  display  time  condition,  which  would  appear  to  be  a  more  stri  ngent  test 
of  the  effect  of  different  screens,  and  also  with  the  results  of  Experi  ment  1  when  i  ncl  udi  ng  al  I 
participants,  it  appears  more  likely  to  be  aType  II  error. 

Tosupportthisinterpretation,  repeated-measures  Wilcoxon  signed  ranks  tests  were  also  used 
to  examine  whether  accuracy  or  certai  nty  varied  between  Experi  ment  land  Experi  ment  3  at 
character  heights  of  8 min  and  10 min.  No  significant  differences  were  found  at  either 
character  height  in  either  the  106  ms  display  time  condition,  whereZ(8)  =-0.11,  p  =  .916 for 
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8  mi  n  characters  and  Z  (8)  =  -0. 72,  p  =  .458 for  10  mi  n  characters,  or  i  n  the  173  ms  d i  spl  ay  ti  me 
condition,  whereZ  (8)  =-.63,  p  =. 526 for  8  min  characters  and  Z  (8)  =0.00,  p  =1.000for  10  min 
characters. 

While  these  results  suggest  that  the  different  display  screens  did  not  give  rise  to  different 
error  or  certainty  results,  it  should  be  noted  that  it  cannot  be  considered  conclusive.  The 
sample  size  was  small  and  caution  is  always  necessary  in  drawing  conclusions  from  null 
results.  In  addition,  all  participants  undertook  Experiment  3  after  Experiment  1,  and  it  may 
have  been  that  the  effect  of  display  screenwas  masked  by  an  order  effect.  However,  therewas 
no  difference  in  accuracy  or  certainty  levels  over  the  period  of  each  trial  block  of 
Experiment  1,  which  suggests  that,  perhaps  as  expected  for  a  simple  perceptual  task  with 
over-learned  stimuli,  therewas  not  a  significant  effect  of  practice  or  time-on-task. 

Thus  whi  le  it  is  diffi  cult  to  definitively  excludethe  influence  of  order  effects  when  comparing 
the  results  of  Experiment  1  and  3,  practice,  as  measured  by  time-on-task,  did  not  appear  to 
affect  the  results  of  Experiment  1.  H  ence,  it  appears  unlikely  that  they  would  mask  a  decrease 
in  performance  due  to  the  display  screen  when  comparing  Experiments  1  and  3.  Thus  it 
appears  that  the  identification  accuracy  and  certainty  results  in  Experiments  1  and  2  were 
insensitiveto  thefact  that  different  display  screens  were  used. 


5.  General  Discussion 

Experiment  1  aimed  to  test  the  minimum  text  and  symbol  size  necessary  to  maintain  fast, 
accurate  and  confident  identification  of  text  and  symbols.  It  presented  letters,  numbers  and 
symbols  at  sizes  ranging  from  20  min  to  8  min  high  for  periods  of  106 ms  and  173  ms  and 
measured  the  size  at  which  identification  accuracy  and  certainty  began  to  decline.  The 
findings  suggest  that  white  and  coloured  letters  and  numbers  must  haveaheight  of  10  minor 
greater  to  maintain  non-significant  error  rates,  and  have  a  height  of  at  least  12.5 min  to 
maintain  high  identification  certainty.  White  and  coloured  symbols  must  have  a  height  of 
12.5  min  or  greater  to  maintain  both  accuracy  and  certainty  of  identification.  H  owever,  these 
results  were  obtained  in  the  absence  of  the  potentially  detrimental  effects  of  ship  motion 
effects  that  are  likely  to  occur  during  naval  operations. 

To  address  this  concern,  Experiment  2  conducted  measurements  four  times  during  a  12-day 
sea  trial,  which  was  conducted  off  the  coast  of  Halifax,  Nova  Scotia,  in  a  period  where  heavy 
seas  were  expected.  The  study  aimed  to  identify  whether  any  change  in  the  identification 
performancewas  evident  over  thecourse  of  thesea  trial,  and  to  identify  theminimum  height 
of  white  letters  needed  to  maintain  optimum  identification  performance  under  conditions 
similar  to  those  experienced  during  naval  operations,  i.e.,  high  sea  states  and  possibly  sea-sick 
operators. 

Based  on  combi  ned  data  from  the  at-sea  measu  rements  of  Experi  ment  2,  a  character  hei  ght  of 
16  mi  n  was  necessary  to  mai  ntai  n  identi fi  cati  on  accu racy  and  certai  nty  for  w hi  te  I  etters  i  n  the 
106  ms  display  time  condition.  This  would  suggest  that  white  letters  should  ideally  have  a 
height  of  16  min  or  greater.  H  owever,  accuracy  and  certainty  improved  if  a  viewing  time  of 
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173  mswas  allowed,  and,  under  this  condition,  thewhiteletter  height  necessary  to  maintain 
identification  accuracy  and  certainty  reduced  to  10 min. 

Experiment  1  tested  white  and  coloured  letters,  numbers  and  symbols  while  Experiment  2 
only  tested  white  letters.  Thus  a  direct  comparison  of  results  can  only  be  done  for  this 
stimulus  category.  For  white  letters,  the  results  of  Experiments  1  and  2  differed  in  the 
rel  ati  onshi  p  of  the  certai  nty  and  accuracy  resu  I  ts,  the  effect  of  d  i  spl  ay  ti  me  and  the  mi  ni  mu  m 
character  height  necessary  to  maintain  identification  performance.  In  Experiment  1, 
i  dentifi  cati  on  certai  nty  was  affected  at  a  I  arger  I  etter  hei  ght  than  i  dentifi  cati  on  error,  whereas 
i  n  Experi  ment  2,  identification  error  and  certainty  were  affected  at  the  same  I  etter  height.  The 
d  i  fferences  i  n  the  certai  nty  resu  Its  can  possi  bl  y  be  expl  ai  ned  by  the  nature  of  thetwo  sampl  es. 
Experi  ment  2  parti  ci  pants  were  defence  force  personnel  w  ho,  by  a  combi  nati  on  of  d  i  sposi  ti  on 
and  training,  may  be  confident  in  their  decisions  and  opinions.  In  contrast,  Experiment  1 
parti  ci  pants  were  DSTO  scientists  who,  it  mi  ght  be  argued,  may  tend  to  be  more  tentative  in 
their  decision  making.  This  explanation  is  of  course  rather  speculative  but,  whatever  the 
reason  for  the  group  differences,  it  would  seem  prudent  to  base  minimum  character  height 
recommendations  on  the  measure  that  is  most  sensitive  for  each  group.  Thus  Experiment  1 
would  suggest  a  mini  mum  white  I  etter  height  of  12.5minand  Experi  ment2would  suggesta 
minimum  white  letter  of  16  min  for  a  display  period  of  106  ms  and  of  10  min  for  a  display 
period  of  173  ms. 

1 1  w  ou  I  d  al  so  seem  p  ru  d  ent  to  base  recommend  ati  ons  on  the  resu  I  ts  of  the  106  ms  d  i  spl  ay  ti  me 
condition,  as  this  would  ensure  optimum  identification  performance.  Thus  the  results  of 
Experi  ment  1  w  ou  I  d  su  ggest  that  the  mi  n  i  mu  m  w  h  i  te  I  etter  hei  ght  shou  I  d  be  12. 5  mi  n  and  the 
resu  I  ts  of  Experi  ment  2  w  ou  I  d  su  ggest  that  the  mi  ni  mu  m  w  hi  te  I  etter  hei  ght  shou  I  d  be  16  mi  n . 
Given  that  the  results  of  Experi  ment  2  were  I  i  kely  to  i  ncorporateany  detri  mental  effects  of  the 
at-sea  envi  ronment  and  were  based  on  a  parti  ci  pant  sampl  ethat  cl  osely  matched  the  expected 
target  pop  u  I  ati  on,  it  can  be  recommended  that  16  mi  n  or  arc  is  the  mi  ni  mum  height  of  white 
letters  displayed  on  naval  combat  management  systems.  Given  that,  in  Experiment  1,  white 
and  coloured  letters,  numbers  and  symbols  were  all  found  to  need  a  minimum  character 
hei  ght  of  12.5  mi  n  to  mai  ntai  n  opti  mal  i  dentifi  cati  on  performance  i  n  an  on-l  and  envi  ronment, 
it  seems  reasonabletocondudethatthesecharacters  should  havealsohavea  minimum  height 
of  16  min  when  displayed  in  naval  combat  management  systems. 

While  16  min  may  be  required  for  optimal  identification  performance,  an  average  fixation 
lasts  approximately  200  ms.  Therefore,  if  characters  can  be  identified  within  this  period,  there 
w  i  1 1  be  no  p racti  cal  effect  on  read  i  ng  speed .  For  a  vi  ew  i  ng  ti  me  of  173  ms  (w  h i  ch  i  s  si  mi  I  ar  to 
the  length  of  an  averagefixation),  the  results  of  Experi  ment  2  suggest  that  white  letters  with  a 
hei  ght  of  10  mi  n  cou  I  d  be  accu  ratel  y  and  conf  i  d  entl  y  i  d  enti  f  i  ed .  Thi  s  rai  ses  the  possi  bility  that, 
while  not  all  owing  for  optimal  identification  performance,  reducing  the  size  of  white  letters 
on  a  naval  combat  management  system  display  to  a  height  of  10 min  may  not  have  a 
substantial  effect  on  reading  speed.  Flowever,  the  sample  size  of  Experiment  2  was  small, 
which  may  limit  its  statistical  power  to  detect  changes  in  identification  performance.  This 
possibility  is  supported  by  an  inspection  of  thedata,  which  shows  the  existence  of  a  trend  for 
accuracy  and  confidence  to  reduce  for  letter  heights  below  16  min,  even  if  a  significant  result 
was  not  obtained  until  letter  heights  were  below  10  min.  Thus  while  increasing  the  viewing 
time  from  106  ms  to  173  ms  may  mean  that  the  mini  mum  letter  height  can  be  reduced  from 


24 


DSTO-RR-0332 


16  min,  itwould  seem  imprudent  to  suggest  that  10  min  is  acceptable.  In  Experiment  1,  the 
highest  error  rates  wereseen  for  white  and  coloured  symbols,  and  there  was  a  steep  increase 
in  identification  errors  for  symbol  height  below  this.  Given  this,  itwould  seem  reasonable  to 
suggest  that  characters  displayed  on  a  naval  combat  management  system  must  have  a 
minimum  height  of  12.5  min  of  arc  in  order  to  support  rapid  and  accurate  identification. 


6.  Conclusions 

For  an  LCD  with  luminance  and  contrast  settings  appropriate  for  the  prevailing  ambientlight 
levels,  thefollowing  recommendations  can  bemadeabout  character  size  and  colour: 

•  White  and  coloured  numbers,  letters  and  combat  symbols  must  be  displayed  at  a 
minimum  character  height  of  12.5 min  in  order  to  support  rapid  and  accurate 
identification,  and  should  be  displayed  at  a  minimum  character  height  of  16  min  to 
enableoptimum  identification  performance  in  an  at-sea  environment. 

•  The  use  of  red  is  not  recommended  unless  the  colour  is  being  used  to  convey 
information.  In  this  case  a  blended  red  may  be  preferable  to  pure  red  for  text  and 
symbols. 
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